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DETAILED ACTION 
Response to Arguments 

Applicant's arguments filed December 14, 2006 have been fully considered but 
they are not persuasive. 

Applicant argues, with respect to claim 1, that Szeliski is clearly inapplicable to 
rendering claim 1 obvious since it relies heavily on using warping during the carrying out 
of the claimed method. However, the Examiner points out that the specification lacks 
support for performing the method of claim 1 without warping any of said source digital 
images. 

Applicant also argues, with respect to claim 1 , that Toyoda is cited to fill in 
Szeliski's failure to disclose the steps of determining the focal length of the source 
digital imaged from the source image and computing from the determined focal length a 
radial exposure transform. However, the Examiner points out that Toyoda is not relied 
upon to teach both the steps of 1) determining the focal length of the source digital 
imaged from the source image and 2) computing from the determined focal length a 
radial exposure transform, but rather only for the step of computing from the determined 
focal length a radial exposure transform. Toyoda was relied upon to teach that the use 
of the focal length to determine the radial transform for the correction of exposure falloff 
is preferred in order to eliminate the need for a lens system having a complicated 
arrangement that is typically needed to correct for exposure falloff (column 1 , lines 62- 
67). As for the step of determining the focal length of the source digital imaged from the 
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source image, this feature is taught by Szeliski (column 15, line 65 - column 16, line 62; 
and figure 1:110). 

Claim Rejections - 35 USC §112 

The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

Claims 1 and 23 are rejected under 35 U.S.C. 112, first paragraph, as failing to 
comply with the written description requirement. The claim(s) contains subject matter 
which was not described in the specification in such a way as to reasonably convey to 
one skilled in the relevant art that the inventor(s), at the time the application was filed, 
had possession of the claimed invention. No support is found in the specification for the 
newly added limitation that "the method is carried out without warping any of said 
source digital images". For purposes of examination, these claims will be examined 
without this limitation. 

Claims 19 and 24 are rejected under 35 U.S.C. 112, first paragraph, as failing to 
comply with the written description requirement. The claim(s) contains subject matter 
which was not described in the specification in such a way as to reasonably convey to 
one skilled in the relevant art that the inventor(s), at the time the application was filed, 
had possession of the claimed invention. No support is found in the specification for the 
newly added limitation that "said composite digital image is formed without warping any 
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of said source digital images". For purposes of examination, these claims will be 
examined without this limitation. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

1. Claims 1-3, 6, 7, 13, 15, 17, 19-20, and 22-24 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Szeliski et al. (US Patent # 6,097,854) in view of 
Toyoda et al. (US Patent # 5,461 ,440). 

2. In regard to claim 1 , note Szeliski discloses the use of a method for producing a 
composite digital image, comprising the steps of providing a plurality of partially 
overlapping source digital images having pixel values that are linearly or logarithmically 
related to scene intensity, wherein the source images have overlap regions wherein 
pixels of the images correspond in scene content and differing in scene content outside 
said overlap regions (figure 1: l 0 -lk), determining the focal length of the source digital 
images from one or more sets of corresponding pixel values of the source digital images 
in said overlap regions (column 15, line 65 - column 16, line 62; and figure 1:110), and 
combining adjusted source digital images to form a composite digital image by blending 
said overlap regions (column 30, lines 20-30; the two images are blended to create a 
mosaic image after other processing/adjustments have been performed). 
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Therefore, it can be seen that the Szeliski device fails to disclose that the 
adjustments that are performed on the images include computing from the determined 
focal length, a radial exposure transform to compensate for exposure fall off as a 
function of the distance of a pixel from the center of the digital image and modifying the 
source digital images by applying a radial exposure transform to one or more of the 
source digital images to produce adjusted source digital images. 

Toyoda discloses the use of the focal length to determine the radial transform for 
the correction of exposure falloff (column 1, lines 49-52, the marginal attenuation is 
considered exposure falloff; column 10, line 17-column 11, line 55; the focal length is 
used to compensate for marginal attenuation in the image). Toyoda teaches that the 
use of the focal length to determine the radial transform for the correction of exposure 
falloff is preferred in order to eliminate the need for a lens system having a complicated 
arrangement that is typically needed to correct for exposure falloff (column 1 , lines 62- 
67). Therefore, it would have been obvious to one of ordinary skill in the art to modify 
the primary device to use focal length determined by Szeliski to determine the radial 
transform for correction of exposure falloff, as suggested by Toyoda, in order to edit the 
image without the use of heavy / large lens systems. 

3. In regard to claim 2, note Szeliski discloses the a step of applying a linear 
exposure transform to one or more of the source digital images prior to combining the 
adjusted source digital images to produce adjusted source digital images having pixel 
values that closely match in an overlapping region (column 30, lines 20-30; the two 
images are blended to create a mosaic image). 
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4. In regard to claim 3, note Toyoda discloses that the radial exposure transform 
includes a cos 4 dependence on the distance from the center of the image (column 1 , 
lines 46-52; the vignetting is influenced by the cos 4 law of illumination). 

5. In regard to claim 6, note Szeliski discloses that the combining step includes 
calculating an average of the pixel values in the overlapping region (column 30, lines 
20-30). 

6. In regard to claim 7, note Szeliski discloses transforming the pixel values of the 
composite digital image to output device compatible color space (column 9, lines 31- 
35). 

7. In regard to claim 1 3, note Toyoda discloses the storage of the transform 
information (column 9, lines 45-48). Therefore, it can be seen that the primary 
reference of Szeliski in view of Toyoda fails to disclose the use of metadata stored with 
the image to store the radial transform. Official notice is taken that the concepts and 
advantages of storing additional image parameters and camera settings as metadata 
are notoriously well known and expected in the art. Therefore, it would have been 
obvious to one of ordinary skill in the art to modify the primary device to include the use 
of metadata to store the radial transform in order to store the associated data together 
for better organization as well as to keep related data together in instances such as data 
transfer from one device to another. 

8. In regard to claim 1 5, note the primary reference of Szeliski in view of Toyoda 
discloses the use of a method for producing a composite digital image as claimed in 
claim 1. Therefore, it can be seen that the primary reference fails to disclose that the 
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radial exposure transform is calculated using a flash indicator. Official notice is taken 
that the concepts and advantages of using a flash indicator to calculate the radial 
exposure transform are notoriously well known and expected in the art. Therefore, it 
would have been obvious to one of ordinary skill in the art to modify the primary device 
to include the use of a flash indicator to calculate the radial transform in order to 
compensate for flash falloff. 

Since applicant did not traverse the Official notice, the statement of common 
knowledge or well-known use of a flash indicator to calculate the radial transform in 
order to compensate for flash falloff, it is therefore, taken to be admitted prior based on 
the requirement of MPEP § 2144.03(c). 

9. In regard to claim 1 7, note Szeliski discloses the use of a computer program 
product comprising computer readable storage medium having a computer program 
stored thereon for performing the method of claim 1 (column 7, lines 46-51). 

10. In regard to claim 19-20, these are apparatus claims, corresponding to the 
method of claims 1-2. Therefore, claims 19-20 have been analyzed and rejected as 
previously discussed with respect claims 1-2. 

11. In regard to claim 22, note Toyoda discloses that the determining step further 
comprises analyzing the exposure falloff in at least one of said overlap regions (column 
10, line 17-column 1 1 , line 55; the focal length is used to analyze the image for marginal 
attenuation in order to compensate the image and reduce the effects of falloff). 

12. In regard to claim 23, note Szeliski discloses the use of a method for producing a 
composite digital image, comprising the steps of providing a plurality of partially 
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overlapping source digital images, each said source digital image having an array of 
pixels, said pixels having values that are linearly or logarithmically related to scene 
intensity, said source digital images having overlap regions wherein pixels of said 
source digital images correspond in scene content, said source digital images differing 
in scene content outside said overlap regions (figure 1: l 0 -lk), determining the focal 
length of the source digital images from one or more sets of corresponding pixel values 
of the source digital images in said overlap regions (column 15, line 65 - column 16, line 
62; and figure 1 :1 1 0), a step of applying a linear exposure transform to one or more of 
the source digital images prior to combining the adjusted source digital images to 
produce adjusted source digital images having pixel values that closely match in an 
overlapping region (column 30, lines 20-30; the two images are blended to create a 
mosaic image), and combining adjusted source digital images to form a composite 
digital image by blending said overlap regions (column 30, lines 20-30; the two images 
are blended to create a mosaic image after other processing/adjustments have been 
performed). 

Therefore, it can be seen that the Szeliski device fails to disclose that the 
adjustments that are performed on the images include computing from the determined 
focal length, a radial exposure transform to compensate for exposure fall off as a 
function of the distance of a pixel from the center of the digital image and modifying the 
source digital images by applying a radial exposure transform to one or more of the 
source digital images to produce adjusted source digital images. 
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Toyoda discloses the use of the focal length to determine the radial transform for the 
correction of exposure falloff (column 1, lines 49-52, the marginal attenuation is 
considered exposure falloff; column 10, line 17-column 11, line 55; the focal length is 
used to compensate for marginal attenuation in the image). Toyoda teaches that the 
use of the focal length to determine the radial transform for the correction of exposure 
falloff is preferred in order to eliminate the need for a lens system having a complicated 
arrangement that is typically needed to correct for exposure falloff (column 1 , lines 62- 
67). Therefore, it would have been obvious to one of ordinary skill in the art to modify 
the primary device to use focal length determined by Szeliski to determine the radial 
transform for correction of exposure falloff, as suggested by Toyoda, in order to edit the 
image without the use of heavy / large lens systems. 

13. In regard to claim 24, this is an apparatus claim, corresponding to the method of 
claims 23. Therefore, claim 24 has been analyzed and rejected as previously discussed 
with respect claim 23. 

14. Claims 4 and 8-10 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Szeliski et al. (US Patent # 6,097,854) in view of Toyoda et al. (US Patent # 
5,461,440) and "Reference Input/Output Medium Metric RGB Color Encodings". 

15. In regard to claim 4, note Szeliski discloses that the step of providing source 
digital images comprises capturing images and storing them in a digital memory 
(column 9, lines 13-18). Therefore, it can be seen that the primary reference of Szeliski 
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in view of Toyoda fails to disclose that the transform is a metric transform that is scene 
independent. 

"Reference Input/Output Medium Metric RGB Color Encodings" discloses the use 
of a metric transform that is applied to a source digital image such that the pixel values 
of the transformed source digital image are linearly or logarithmically related to scene 
intensity that is scene independent (found in the abstract, RIMM/ROMM is an metric 
encoding technique used to transform the source images; and in the first two 
paragraphs of the Introduction it can be seen that the image can be device dependent 
instead of scene dependent). "Reference Input/Output Medium Metric RGB Color 
Encodings" teaches that the use of a metric transform applied to a source digital image 
such that the pixel values of the transformed source digital image are linearly or 
logarithmically related to scene intensity that is scene independent is preferred in order 
to increase the dynamic range of the stored image in order to match a device (page 7: 
ERIMM RGB Color Encoding). Therefore, it would have been obvious to one of 
ordinary skill in the art to modify the primary device to include the use of a metric 
transform that is applied to a source digital image such that the pixel values of the 
transformed source digital image are linearly or logarithmically related to scene intensity 
that is scene independent in order to increase the dynamic range of the stored image 
as suggested by "Reference Input/Output Medium Metric RGB Color Encodings". 
16. In regard to claim 8, note "Reference Input/Output Medium Metric RGB Color 
Encodings" discloses that the metric transform includes a color transformation matrix 
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(page 4: ROMM RGB Conversion Matrix- the transform uses a color transformation 
matrix). 

17. In regard to claim 9, note "Reference Input/Output Medium Metric RGB Color 
Encodings" discloses that the metric transform includes a lookup table (page 
2:Selection of Color Space- paragraph 2, "simple LUT-matrix-LUT transformation can 
be used"). 

18. In regard to claim 10, note Szeliski in view of Toyoda and "Reference 
Input/Output Medium Metric RGB Color Encodings" discloses the use of a method for 
producing a composite digital image as claimed in claim 4. Therefore, it can be seen 
that the primary reference fails to disclose that the metric transform is included as 
metadata with the corresponding source digital image. Official notice is taken that the 
concepts and advantages of storing information pertaining to the image as metadata is 
notoriously well known and expected in the art. Therefore, it would have been obvious 
to one of ordinary skill in the art to modify the primary device to include the storage of 
the metric transform as metadata in order to store the associated data together for 
better organization as well as to keep related data together in instances such as data 
transfer from one device to another. 

Since applicant did not traverse the Official notice, the statement of common 
knowledge or well-known use of storing additional information pertaining to the image 
as metadata, it is therefore, taken to be admitted prior based on the requirement of 
MPEP § 2144.03(c). 
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19. Claim 11 is rejected under 35 U.S.C. 103(a) as being unpatentable over Szeliski 
et al. (US Patent # 6,097,854) in view of Toyoda et al. (US Patent # 5,461 ,440) and 
Inoue et al. (US Patent # 5,083,209). 

20. In regard to claim 1 1 , note the primary reference of Szeliski in view of Toyoda 
discloses the use of a method for producing a composite digital image as claimed in 
claim 23. Therefore, it can be seen that the primary reference fails to disclose that the 
linear exposure transform is a function of the shutter speed used to capture the source 
digital image, and that the shutter speed is included as meta-data with the 
corresponding source digital image. 

Inoue discloses the use of an exposure transform that is a function of the shutter 
speed used to capture the image (column 2, lines 9-12; and column 3, lines 7-16; the 
brightness is adjusted based on a function of shutter speed; the shutter speed is 
changed to obtain the desired brightness). Inoue teaches that the use of a transform 
that is a function of shutter speed is preferred in order to obtain the desired brightness 
values of the image (column 2, lines 9-12). Therefore, it would have been obvious to 
one of ordinary skill in the art to modify the primary device to include the use of a 
transform that is a function of shutter speed as suggested by Inoue. 

Official notice is taken that the concepts and advantages of storing additional 
image parameters and camera settings as metadata are notoriously well known and 
expected in the art. Therefore, it would have been obvious to one of ordinary skill in the 
art to modify the primary device to include the use of metadata to store the shutter 
speed in order to store the associated data together for better organization as well as to 
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keep related information together for instances such as data transfer from one device to 
another. 

Since applicant did not traverse the Official notice, the statement of common 
knowledge or well-known use of storing additional information pertaining to the image 
as metadata, it is therefore, taken to be admitted prior based on the requirement of 
MPEP § 2144.03(c). 

21. Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over Szeliski 
et al. (US Patent # 6,097,854) in view of Toyoda et al. (US Patent # 5,461,440) and 
Hirai et al. (US Patent #6,603,928). 

22. In regard to claim 12, note the primary reference of Szeliski in view of Toyoda 
discloses the use of a method for producing a composite digital image as claimed in 
claim 23. Therefore, it can be seen that the primary reference fails to disclose that the 
linear exposure transform is a function of the f-number used to capture the source 
digital image and that the f-number is included as meta-data with the corresponding 
source digital image. 

Hirai discloses the use of an exposure transform that is a function of the f- 
number used to capture the image (column 2, lines 10-25; and column 3, lines 16-17; 
the f-number is used to compensate the image). Hirai teaches that the use of a 
transform that is a function of the f-number is preferred in order to correct image 
coloring to a desire value (column 2, lines 10-30). Therefore, it would have been 
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obvious to one of ordinary skill in the art to modify the primary device to include the use 
of a transform that is a function of the f-number as suggested by Hirai. 

Official notice is taken that the concepts and advantages of storing additional 
image parameters and camera settings as metadata are notoriously well known and 
expected in the art. Therefore, it would have been obvious to one of ordinary skill in the 
art to modify the primary device to include the use of metadata to store the shutter 
speed in order to store the associated data together for better organization as well as to 
keep related information together for instances such as data transfer from one device to 
another. 

Since applicant did not traverse the Official notice, the statement of common 
knowledge or well-known use of storing additional information pertaining to the image 
as metadata, it is therefore, taken to be admitted prior based on the requirement of 
MPEP§ 2144.03(c). 



23. Claims 18 and 21 objected to as being dependent upon a rejected base claim, 
but would be allowable if rewritten in independent form including all of the limitations of 
the base claim and any intervening claims. 

24. As for claims 18, the prior art does not teach or fairly suggest the use of a 
method for producing a composite digital image using the root of the function: 



Allowable Subject Matter 
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to calculate the focal length of the overlapping regions. 

25. As for claims 21 , the prior art does not teach or fairly suggest the use of a system 
for producing a composite digital image using the root of the function: 
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to calculate the focal length of the overlapping regions. 



Conclusion 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Vivek Srivastava can be reached on (571) 272-7304. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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